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Abstract 

Establishing arc consistency on two relational structures is one of the most 
popular heuristics for the constraint satisfaction problem. We aim at deter- 
mining the time complexity of arc consistency testing. The input structures 
G and H can be supposed to be connected colored graphs, as the general 
problem reduces to this particular case. We first observe the upper bound 
0{e{G)v{H) + v{G)e{H)), which implies the bound 0{e{G)e{H)) in terms of 
the number of edges and the bound 0{{v{G) + v{H)Y) in terms of the number 
of vertices. We then show that both bounds are tight up to a constant factor 
as long as an arc consistency algorithm is based on constraint propagation 
(like any algorithm currently known). 

Our argument for the lower bounds is based on examples of slow constraint 
propagation. We measure the speed of constraint propagation observed on a 
pair G, H by the size of a proof, in a natural combinatorial proof system, 
that Spoiler wins the existential 2-pebble game on G, H. The proof size is 
bounded from below by the game length D{G,H), and a crucial ingredient 
of our analysis is the existence of G,H with D{G,H) = 0,{v{G)v{H)). We 
find one such example among old benchmark instances for the arc consistency 
problem and also suggest a new, different construction. 



1 Introduction 

According to the framework of yij, the constraint satisfaction problem (CSP) takes 
two finite relational structures as input and asks whether there is a homomorphism 
between these structures. In this paper we consider structures with unary and 
binary relations and refer to unary relations as colors and to binary relations as 
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directed edges. In fact, most of the time we deal with structures having only one 
binary, symmetric and irreflexive relation E, i.e., with vertex-colored graphs. This 
is justified by a linear time reduction from the CSP on binary structures to its 
restriction on colored graphs; see Section [STTl Note that the CSP restricted to colored 
graphs and digraphs has also been studied under the name "List Homomorphism" 
from an algebraic point of view. 

Let G and H be an input of the CSP. It is customary to call the vertices of G 
variables and the vertices of H values. A mapping from V{G) to V{H) then corre- 
sponds to an assignment of values to the variables, and the assignment is satisfying 
if the mapping defines a homomorphism. Let a domain C V{H) of a variable 
X e V{G) be a set of admissible assignments to this variable. Formally, is a 
domain if for every homomorphism h : G ^ H it holds that h{x) G D^- The aim of 
the arc consistency heuristic is to find small domains in order to shrink the search 
space. The first step of the arc consistency approach is to ensure node consistency, 
that is, Dx is initialized to the set of vertices in H that are colored with the same 
color as x. The second step is to iteratively shrink the domains according to the 
following rule: 

If there exists an a G and a variable y G V{G) such that {x,y} G 
E{G) and {a, b} ^ E{H) for all b G Dy, then delete a from D^. 

A pair of graphs augmented with a set of domains is arc consistent if the above 
rule cannot be applied and all domains are nonempty. We say that arc consistency 
can be established for G and H, if there exists a set of domains such that G and 
H augmented with these domains is arc consistent. Our aim is to estimate the 
complexity of the following decision problem. 

AC-Problem 

Input: Two colored graphs G and H. 
Question: Can arc consistency be established on G and H7 



Using known techniques for designing arc consistency algorithms, we observe that 
the AC-Problem can be solved in time 0{v{G)e{H) + e{G)v{H)), where v{G) and 
e{G) denote the number of vertices and the number of edges respectively. Since 
this gives us only a quadratic upper bound in terms of the overall input size, there 
could be a chance for improvement: Is it possible to solve the AC-Problem in 
sub-quadratic or even linear time? In fact, we cannot rule out this possibility com- 
pletely. The first author [2] recently obtained lower bounds for higher levels of k- 
consistency (note that arc consistency is equivalent to 2-consistency). In particular, 
15-consistency cannot be established in linear time and establishing 27-consistency 
requires more than quadratic time on multi-tape Turing machines. The lower bounds 
are obtained in |2] via the deterministic time hierarchy theorem and, unfortunately, 
these methods are not applicable to arc consistency because of the blow-up in the 
reduction. 
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However, we show lower bounds for every algorithm that is based on constraint 
propagation. A propagation- based arc consistency algorithm is an algorithm that 
solves the AC-Problem by iteratively shrinking the domains via the arc consistency 
rule above. Note that all currently known arc consistency algorithms (as e.g. AC-1, 
AC-3 [3]; AC-3.1/AC-2001 [4]; AC-3.2, AC-3.3 [5]; AC-3d [6]; AC-4 [7]; AC-5 0; AC- 
6 IH; AC-7 [lO]; AC-8 [11], AC-* ^12]) are propagation-based in this sense. Different 
AC algorithms differ in the principle of ordering propagation steps; for a general 
overview we refer the reader to [1]. The upper bound 0{v{G)e{H) + e{G)v{H)) 
implies 0{e{G)e{H)) in terms of the number of edges and 0{n^) in terms of the 
number of vertices n = v{G) +v{H). Our main result. Theorem 15.31 in Section [5], 
states that both bounds are tight up to a constant factor for any propagation-based 
algorithm. 

We obtain the lower bounds by exploring a connection between the existential 
2-pebble game and propagation-based arc consistency algorithms. In its general 
form the existential /c-pebble game is an Ehrenfeucht-Fraisse like game that deter- 
mines whether two finite structures can be distinguished in the existential-positive 
/c-variable fragment of first order logic. It has found applications also outside of 
finite model theory: to study the complexity and expressive power of Datalog [13] , 
/c-consistency tests [H ISl [161 12] and bounded-width resolution [TTldH]. It turns out 
that the existential 2-pebble game exactly characterizes the power of arc consistency 
[H], i.e.. Spoiler wins the existential 2-pebble game on two colored graphs G and H 
iff arc consistency cannot be established. 

The connection between the existential 2-pebble game and arc consistency algo- 
rithms is deeper than just a reformulation of the AC-Problem. We show that every 
constraint propagation-based arc consistency algorithm computes in by-passing a 
proof of Spoiler's win on instances where arc consistency cannot be established. On 
the one hand these proofs of Spoiler's win naturally correspond to a winning strat- 
egy for Spoiler in the game. On the other hand they reflect the propagation steps 
performed by an algorithm. We consider three parameters to estimate the complex- 
ity of such proofs: length, size and depth. The length corresponds to the number 
of propagation steps, whereas size also takes the cost of propagation into account. 
The depth corresponds to the number of "nested" propagation steps and precisely 
matches the number of rounds D{G, H) Spoiler needs to win the game. We observe 
that the minimum size of a proof of Spoiler's win on G and H bounds from below 
the running time of sequential propagation-based algorithms, whereas the minimal 
depth matches the running time of parallel algorithms. 

We exhibit pairs of colored graphs G,H where D{G,H) = Q{v{G)v{H)) and 
hence many nested propagation steps are required to detect arc-inconsistency. Be- 
cause these graphs have a linear number of edges this implies that there is no sub- 
quadratic propagation-based arc consistency algorithm. It should be noted that 
CSP instances that are hard for sequential and parallel arc consistency algorithms, 
in the sense that they require many propagation steps, have been explored very 
early in the Al-community [T^ [2U] . Such examples were also proposed to serve as 
benchmark instances to compare different arc consistency algorithms [2I|. Graphs G 
and H with large D{G, H) can be derived from the old Domino example, consisting 
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of structures with two binary relations. We also provide a new example, which we 
call Co-Wheels, that shows the same phenomenon of slow constraint propagation 
for a more restricted class of rooted loopless digraphs. 

The rest of the paper is organized as follows. In Section [2] we give the necessary 
information on the existential 2-pebble game and use it to analyze the Domino 
pattern. Our Co- Wheels pattern is introduced and analyzed in Section [31 Section 
mis devoted to the winner proof system for the existential 2-pebble game. The facts 
obtained here are used in Section O to prove our main results on the complexity of 
propagation-based algorithms for the AC-Problem. 

2 Preliminaries 

A binary structure A is a relational structure over vocabulary a = {Ei, E2, . . . , Ui, 
U2, ■ ■ ■} consisting of binary relations Ei, i > 1, and unary relations Uj, j > 1. Each 
binary relation Ef between elements of A can be regarded as a directed graph with 
arrows (x, y) G Ef colored in color i. Similarly, the unary relations Uf can be 
thought of as colors of elements of A. In this way, we can consider A an edge- and 
vertex-colored directed graph. The elements of A will be then called vertices. The 
set of the elements of A will be denoted by V{A) and their number by v{A). 

In colored graphs we additionally have unary relations of vertex colors, i.e., a = 
{El, Ui,U2, . . .). Moreover, it is supposed that any two color classes Uf and Up are 
disjoint. The number of edges in a colored graph A is denoted by e[A). 

The existential 2-pebble game on binary structures A and B is played by two 
players. Spoiler and Duplicator, to whom we will refer as he and she respectively. 
The players have equal sets of two pairwise different pebbles, p and q. A round 
consists of a move of Spoiler followed by a move of Duplicator. Spoiler takes a 
pebble, p or q, and puts it on a vertex in A. Then Duplicator has to put her copy of 
this pebble on a vertex of B. Duplicator's objective is to keep the following condition 
true after each round: the pebbling should determine a partial homomorphism from 
A to B. 

Let X G V{A) and u G V{B) denote the vertices pebbled by p and y G V{A) 
and V G V{B) denote the vertices pebbled by q. Thus, Duplicator loses as soon as 
X G up while u ^ for some j, or {x,y) G Ep while {u,v) ^ E^ , or G Ep 

while {y,u) ^ Ef for some i, or x = y while u ^ v. 

For each positive integer r, the r-round 2-pebble existential game on A and B 
is a two-person game of perfect information with a finite number of positions. By 
Zermelo's theorem, either Spoiler or Duplicator has a winning strategy in this game, 
that is, a strategy winning against every strategy of the opponent. Let D{A,B) 
denote the minimum r for which Spoiler has a winning strategy. If such r does 
not exist, we will write D{A,B) = 00. As it is well known [13], D{A,B) < r if 
and only if A can be distinguished from 5 by a sentence of quantifier rank r in 
the existential-positive two-variable logic. The existential-positive fragment of first- 
order logic consists of formulas containing only monotone Boolean connectives and 
only existential quantifiers (thus, negation and universal quantification is forbidden). 
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Suppose that D{A,B) < oo. We say that Spoiler plays optimally if he never 
loses an opportunity to win as soon as possible. More specifically, after a round 
is ended in a position P (determined by the pebbled vertices), Spoiler makes the 
next move according a strategy that allows him to win from the position P in the 
smallest possible number of rounds. 

Lemma 2.1 If Spoiler plays optimally, then the following conditions are true. 

1. Spoiler uses the pebbles alternatingly, say, p in odd and q in even rounds. 

2. Whenever Spoiler moves a pebble, he moves it to a new position. That is, 
if Xi G V{A) denotes the vertex pebbled in the i-th round, then Xi^2 7^ Xi. 
Moreover, if Xi+i = Xi, then 7^ a^i-i- 

3. {xi^Xi^i) or {xi^i^Xi) satisfies at least one binary relation. 

Proof. Recall that a position P in the game is a tuple in V{AY x V{BY or in 
V{A) X V{B) consisting of the currently pebbled vertices. By assumption. Spoiler 
has a strategy allowing him to win the game within some number of rounds. Then, 
for every P there is an r such that Spoiler has a winning strategy in the r-round 
game with the initial position P. Denote the smallest such r by R{P). We will 
denote the vertex of B pebbled by Duplicator in the i-th round by Ui. 

1. We first show this for the first two rounds. Let R denote the minimum number 
r such that Spoiler has a winning strategy in the r-round game. It is clear that in 
the first round Spoiler pebbles a vertex Xi G V{A) such that max„gy(5) R{xi,u) is 
equal to the minimum possible value R—1. If in the second round Spoiler just moves 
the pebble from xi to another vertex X2, then Duplicator can pebble a vertex U2 
attaining maXuev{B) R{x2, u) > R — 1. This allows her to win the next r — 2 rounds, 
contradictory to the fact that the optimal strategy used by Spoiler is winning in the 
i?- round game. 

Assume now that Spoiler has used the pebble p in the {i — l)-th round and the 
pebble q in the i-th round, and the game is not over yet. By the definition of an opti- 
mal strategy, the value R' — max^ R{xi-i,Xi, Ui^i, u) is minimum possible among all 
choices of Xi. From now on Spoiler has to win the game in at most r' rounds. If, how- 
ever, in the (i + l)-th round Spoiler uses the pebble q again moving it from Xi to Xj+i, 
then Duplicator can pebble a vertex Ui^i attaining max„ R{xi_i, Xj+i, itj-i, u) > R' . 
This allows her to win the further i?' — 1 rounds, contradicting Spoiler's optimality. 

2. The definition of an optimal strategy implies that, after the i-th round is 
played. Spoiler wins in at most R{xi-i,Xi,Ui-i,Ui) rounds. Assume that in the 
{i + l)-th round Spoiler pebbles Xj+i = Xi_i. Not to lose immediately, Duplicator 
pebbles Ui^i = Starting from the next round. Duplicator is able to stand up in 
R{xi, Xi-i, Ui, — 1 = R{xi_i,Xi, Mj-i, Ui) — 1 rounds, which gives a contradiction. 

If Xi+i — Xi, the inequality Xi+2 7^ Xi-i follows by a similar argument. 

3. Part 1 of the lemma shows that after the i-th round the players actually play 
the game with the initial position {xi,Ui) (that is. Spoiler's optimal strategy can 
be supposed to be independent of the pair (a;j_i, In particular. Spoiler has 
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Figure 1: The Domino example. 



a strategy allowing him to win the rest of the game in R{xi,Ui) < R — i rounds, 
where R is as defined above. Assume that the vertices Xi and Xj+i satisfy no binary 
relation in A. Then every choice of Wj+i G V{B) is non-losing for Duplicator in the 
{i + l)-th round. If she chooses Mj+i attaining ma.Xu^v{B) > R — 1, then 

she has a strategy allowing her to survive at least R — 1 further rounds after the 
i-th round, a contradiction. ■ 

Lemma 12.11 has several useful consequences. The first of them implies that, 
without loss of generality, we can restrict our attention to connected structures. 
Two distinct vertices of a binary structure A are adjacent in its underlying graph 
Ga if they satisfy at least one binary relation of A. Connected components of A are 
considered with respect to Ga- Let A consist of connected components Ai, . . . , 
and B consist of connected components Bi, . . . , Bi. Then it easily follows from part 
3 of Lemma mi] that D{A, B) = miuj max^ D[Ai, Bj). Another consequence follows 
from parts 2 and 3. 

Corollary 2.2 Suppose that the underlying graph Ga of A is a tree. If D{A, B) < 
oo, then D{A,B) < 2v{A). 

Proof. Consider the existential 2-pebble game on A and B and assume that 
Spoiler follows an optimal strategy. By part 3 of Lemma 12. he all the time moves 
the pebbles along a path in Ga- By part 2 of the lemma, he never turns back. Since 
Ga is a tree, the game lasts at most 2(i(G^) + 1 < 2v{A) rounds, where d{GA) 
denotes the diameter of Ga- ■ 

Furhtermore, we now can state a general upper bound for D{A, B). 

Corollary 2.3 If D{A,B) < oo, then D{A,B) < v{A)v{B) + 1. 

Proof. Assume that Spoiler plays optimally. Let Xi G V{A) and Ui G V{B) denote 
the vertices pebbled in the i-th round. By part 1 of Lemma 12.11 we can further as- 
sume that Spoiler's move in the (i + l)-th round depends only on the (xj, Ui). It read- 
ily follows that, if the game lasts r rounds, then the pairs . . . , {xr^i,Ur^i) 
are pairwise different, and hence r — 1 < v{A)v{B). ■ 

The bound of Corollary 12.31 is tight, at least, up to a factor of 1/2. A suitable 
lower bound can be obtained from the CSP instances that appeared in [191 El] under 
the name of DOMINO problem and were used for benchmarking the arc consistency 
algorithms. A Domino instance consists of two digraphs Am and Bn whose arrows 
are colored in red and blue; see Fig. [H Am is a directed cycle of length m with 
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Figure 2: An example of Co- Wheels 



one blue and the other red arrows. is a blue directed path where red loops are 
attached to all its n vertices. Spoiler can win the existential 2-pebble game on 
and Bn by moving the pebbles along the cycle Am, always in the same direction. 
By Lemma 12. this is the only way for him to win in the minimum number of 
rounds. When Spoiler passes red edges, Duplicator stays with both pebbles at the 
same vertex of Bn- Only when Spoiler passes the blue edge, Duplicator passes one 
(blue) edge forward in B^. Thus, if Duplicator starts playing in the middle of 
she survives in at least | m(?T, — 1) rounds. 

3 More examples of slow constraint propagation 

The Domino pairs are remarkable examples of binary structures on which constraint 
propagation is as slow as possible, up to a constant factor of 1/2. An important 
role in the Domino example is played by the fact that we have two different edge 
colors. We now show that essentially the same lower bound holds true over a rather 
restricted class of structures, namely rooted loopless digraphs, where edges are un- 
colored, there is a single color for vertices, and only a single root vertex is colored 
in it. It is also supposed that every vertex of a rooted digraph is reachable from the 
root along a directed path. 

By the wheel Wn we mean the rooted digraph with n + 1 vertices where there are 
arrows from the root to all the other n vertices and these vertices form a directed 
cycle. We call a pair of rooted digraphs Gm and iJ„ co-wheels if Gm is obtained 
from Wm by removal of all but one arrows from the root and Hn is obtained from 
Wn by removal of one arrow from the root; see an example in Fig. [21 

Lemma 3.1 Let Gm and Hn be co-wheels. If m and n are coprime, then D{Gm, 
Hn) < CO and D{Gm, Hn) > \ m{n — 3). 

Proof. Let V{Gm) = {xo, . . . , Xm-i} and V{Hn) = {ao, . . . , a„_i}. Assume that xq 
is adjacent to the root of G^., Oo is non-adjacent to the root of Hn, and the indices 
increase in the direction of arrows. We first argue that Spoiler has a winning strategy 
in the existential 2-pebble game on Gm and Hn- Let Spoiler pebble Xq in the first 
round and assume that Duplicator responds with at. If t = 0, Spoiler wins by putting 
the other pebble on the root. If t > 0, Spoiler is able to force pebbling the pair 
[xq, ao) in a number of rounds. Indeed, if Spoiler moves the pebbles alternatingly 
along the cycle so that the pebbled vertices are always adjacent, then after im 
rounds Spoiler passes the cycle i times and arrives again at Xq, while Duplicator 
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is forced to come to at+em, where the index is computed modulo n. Since m and 
n are coprime, m mod n is a generator of the cychc group Z„. It follows that the 
parameter i can be chosen so that t + im = (mod n), and then at+e-m = do- 

We now have to show that Duplicator is able to stand up in at least ^m{n — 
3) rounds. Estimating the length of the game, we can assume that Spoiler plays 
according to an optimal strategy. It readily follows by Lemma [2TT] that Spoiler begins 
playing in a non-root vertex Xg and forces pebbling the pair (xo,ao) as explained 
above, by moving along the cycle always in the same direction. Let D{xs, at) denote 
the minimum number of moves needed for Spoiler to reach this configuration if 
Duplicator's move in the first round is at. 

Suppose first that s = and also that Spoiler moves in the direction of arrows. 
Then he can force pebbling (a;o, cto) only in im moves with i satisfying t + im = 
(mod n). Denote / = \n/2\ and let Duplicator choose t = {—Im) mod n. Then 
the smallest possible positive value of i is equal to /. If Spoiler decides to move in 
the opposite direction, we have the relation t — im = (mod n), which gives us 
i > r^/2l. In both cases D{xo,at) > ^m{n — 1). 

Suppose now that s > 0. Let Duplicator pebble in the first round with t' = 
(t + s) mod n, where t is fixed as above. Note that Spoiler from the position (xq, at) 
is able to force the position (x^, a^) in s moves. Therefore, -D(xo, at) < s + D{xs,at'), 
which implies that D{xs, af) > D{xo, at) — (m — 1) > | m{n — 3), as claimed. ■ 



Theorem 3.2 For every pair of numbers M > 5 and N > 5, there is a pair of rooted 
loopless digraphs G and H with v{G) = M and v{H) = N such that D{G, H) < oo 
and D{G,H) > (| — o{l))MN. Here the o{l)-term is a function o/max(M, A^). 

Proof. Given co- wheels Gm and add k new vertices to Gn and I new vertices 
to Hn (and arrows to these vertices from the roots) and denote the resulting rooted 
digraphs by by H^. Since the new vertices are useless for both Spoiler and 
Duphcator, we have D{G^, H^) = D{G,n, H^) for any k,l > 0. 

Denote m = M — 1 and n = N — 1. If m and n are coprime, then we can take 
G = Gm, H = Hn, and Lemma 13.11 does the job. Consider now the case that m 
and n are not coprime. If m is a prime divisor of n, then m and n — 1 are coprime, 
and we can take G = Gm and H = in this case. The case that n is prime is 

similar. If none of m and n is prime, let p < n be the prime closest to n. By [22j, 
we have p > n — for a large enough n. Assume first that p does not divide m. 
Since these two numbers are coprime, we can take G = Gm and H = H^~^ getting 

D{G, H) = D{Gm, Hp) > 1 m(p - 3) > ^ m{n - n^-^^s _ 3)_ 

If p divides m, the numbers m — 1 and p are coprime, and we take G = G^-i ^"^^ 

H = H^-P. m 

Using a simple gadget, in the Co- Wheels pattern we can make edges undirected 
simulating directions by vertex colors. In this way, we can construct examples of 
pairs with large -D(G, H) also for colored graphs; see Fig. |3l 
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Figure 3: Co-Wheels as colored graphs. 




Figure 4: The colored graphs obtained from the Domino example in Fig. [H 

Corollary 3.3 Theorem \3.2\ holds true also for colored graphs with bound D{G, H) > 
(i-o(l))MiV. 

Corollary 13.31 can be obtained also from the Domino pattern, though with a 
smaller factor | — o(l); see Fig. HI It is worth noting that G will be a unicyclic 
graph while H will be a tree (more exactly, H will be a caterpillar and can be made 
even a path at he cost of further decreasing the constant factor to ^ — o(l)). Note 
that this result is best possible in the sense that, by Corollary \2.2\ G cannot be a 
acyclic. 

Corollary 3.4 For every M > 2 there is a unicyclic colored graph Gm with M ver- 
tices and for every N > 1 there is a tree with N vertices such that D{Gm, H^) < 
oo andD{GM,HN) > |(M - l)(iV - 5). 

Remark 3.5 Feder and Vardi [1] showed that a general CSP is equivalent to the 
homomorphism problem restricted to directed acyclic graphs (dags). In view of this 
result, it is natural that Corollary 13.31 is true also for uncolored dags. Indeed, the 
directed cycles in Co-Wheels can be broken by subdividing each arrow in the cycle 
into three arrows oriented in different directions. The root nodes can be designated 
by attaching additional arrows; see Fig. |5l In fact, any distinguishable uncolored 
digraphs G and H with large D{G, H) must be acyclic: The existence of a directed 
cycle or a loop in G or if implies that either D{G, H) = oo or D{G^ H) < v{H) + 1. 



4 Winner proof systems 

Inspired by [22], we now introduce a notion that allows us to define a few useful 
parameters measuring the speed of constraint propagation. In the next section it 
will serve as a link between the length of the existential 2-pebble game on {A, B) 
and the running time of an AC algorithm on input {A, B). 
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Figure 5: Co-Wheels as dags. 



Let G and H be connected colored graphs, both with at least 2 vertices. A proof 
system of Spoiler's win on {G,H) consists of axioms, that are pairs {y,b) G V{G) x 
V{H) with y and b colored differently, and derivations of pairs (x, a) e V{G) x V{H) 
and a special symbol _L by the following rules: 

• (x, a) is derivable from a set {(y, 61), . . . , (y, fo^)} such that y G iV(a;) and 
{6i,...,6,} = iV(a); 

• _L is derivable from a set {?/} x V^(i/). 

A proof is a sequence P = pi, . . . ,pe+i such that if ? < £, then pi G V^(G') x V{H) 
and it is either an axiom or is derived from a set {pi-^ pi^} of preceding pairs Pi ; 
also, pe+i = ± is derived from a set of preceding elements of P. More precisely, we 
regard P as a dag on £ + 1 nodes where a derived pi sends arrows to each pi^ used 
in its derivation. Moreover, we always assume that P contains a directed path from 
± to each node, that is, every element of P is used while deriving ±. 

We define the length and the size of the proof P as length{P) = v{P) — 1 and 
size{P) = e(P) respectively. Note that length{P) is equal to i, the total number 
of axioms and intermediate derivations in the proof. Since it is supposed that the 
underlying graph of P is connected, we have length{P) < size{P), where equality 
is true exactly when P is a tree. The depth of P will be denoted by depth{P) and 
defined to be the length of a longest directed path in P. Obviously, depth{P) < 
length{P). 

It is easy to show that a proof P exists iff D{G, H) < 00 (cf. part 1 of Theorem 
14.11 below). Given such G and H, define the (proof) depth of {G,H) to be the 
minimum depth of a proof for Spoiler's win on {G, H). The (proof) length and the 
(proof) size of {G,H) are defined similarly. We denote the three parameters by 
depth{G, H), length{G,H), and size{G, H), respectively. Note that depth{G, H) < 
length{G,H) < szze{G,H). 

Theorem 4.1 Let G and H he connected colored graphs, both with at least 2 verices, 
such that D{G,H) < 00. 

1. depth{G,H) = D{G,H). 

2. depth{G, H) < length{G, H) < v{G)v{H) and this is tight up to a constant 
factor: for every pair of integers M, N > 2 there is a pair of colored graphs 
G, H with v{G) = M and v{H) = N such that depth{G, i/) > (| - o(l)) MN. 



10 



3. s%ze{G,H) <2v{G)e{H) + v{H). 



4- For every N there is a pair of colored graphs Gn and both with N vertices 
such that size{GN, H]\f) > N'^ for all large enough N. 

Note that part 3 implies that size{G, H) < if both G and H have vertices. 
Therefore, part 4 shows that the upper bound of part 3 is tight up to a constant 
factor. 

Proof. 1. It suffices to prove that, for every r > 0, Spoiler has a strategy allowing 
him to win in r rounds starting from the position {x, a) if and only if the pair (x, a) 
is derivable with depth r. This equivalence follows by a simple inductive argument 
on r. 

2. The upper bound follows from a simple observation that any proof can be 
rewritten so that every axiom used and every derived pair apears in it exactly once. 
The lower bound follows by part 1 from Corollary 13.31 

3. Consider a proof P where each pair [x, a) appears at most once. Since the 
derivation of {x, a) contributes deg a arrows in P, and the derivation of _L contributes 
v{H) arrows, we have 

szze(P) < ^dega + t7(/7) = t;(G') ^ dega + = 2v{G)e{H) + v{H). 

The inequality is strict because there must be at least one axiom node, which has 
out- degree 0. 

4. Note that size{G,H) > depth{G, H)6{H), where S{H) denotes the minimum 
vertex degree of H. Therefore, we can take graphs G and H with almost the same 
number of vertices and with quadratic depth{G, H), and make S{H) large by adding 
linearly many universal vertices of a new color to each of the graphs. A universal 
vertex is adjacent to all other vertices in the graph. If each of the graphs receives 
at least two new vertices, they make no influence on the duration of the existential 
2-pebble game. 

More specifically, we use the co- wheels from Lemma [3711 with coprime parameters 
m = n — 1 converted to colored graphs as in Corollary 13. 3j see Fig. Ei Thus, we 
have colored graphs G and H with v{G) = 3n — 2 and v{H) = 3?7, + 1 such that 
D{G,H) > I (n — l){n — 3). Add green universal vertices so that the number of 
vertices in each graph becomes A^ = [| nj . For the new graphs Gn and we still 
have D{Gn, Hn) > | (n — — 3) while now 6{Hn) > ^n. ■ 

Remark 4.2 In general, the proof depth can be much smaller than the proof length. 
In fact, for every n there are two colored graphs G and H with v{G) = n + 1 and 
v{H) = 2n such that depth{G, H) = 2 and length{G,H) = n"^. For example, let 
G be the star Ki n with all vertices colored differently. Let the central vertex be 
colored in red. In order to construct H, begin with the complete bipartite graph 
Kn,n where one part of vertices is colored completely in red and the other part is 
colored as the set of leaves in G. To obtain G, we remove a matching {n pairwise 
non-adjacent edges) from this graph. Here we use n + 1 colors. This number can be 
made fixed similarly to |21 Section III.F]. 
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5 Time complexity of Arc Consistency 



5.1 Reduction to colored graphs 

In this subsection we justify our focusing on colored graphs by showing a hnear 
time reduction from the AC-Problem to its restriction on colored simple connected 
graphs (that also preserves the parameter D{A,B)). The size of a binary structure 
A with binary relations Ei,E2, . . . and unary relations Ui, U2, ... is defined to be 
\\A\\ = j:^\Ef\ + E,\Uf\. 

Lemma 5.1 There is a linear time reduction that takes two relational structures A 
and B with arbitrary unary and binary relations and computes two colored simple 
connected graphs G and H such that 

• A and B pass the arc consistency test iff so do G and H , 

• D{G,H) = Q{D{A,B)), 

. v{G)=0m\),e{G) = 0m\), 

. v{H) = 0m\),e{H)=0m\)- 

Proof. For every binary relation R we introduce two new vertex colors light-i? and 
dark-i? and replace every pair (x, y) & Rin Aoi Bhy an undirected path (x, r, r', y) 
where r is colored light-i? and r' is colored dark-i?. Each triple x, ?/, R is handled 
by its own pair r, r'. Note that a loop (x,x) G R gives rise to a cycle (x,r, r') of 
length 3. 

We also have to ensure that the vertex colors in G and H are disjoint even if the 
unary relations in A and B overlap. To this end, for every unary relation U and 
vertex x G ?7 in A or S we remove x from U but create a new vertex s & U adjacent 
to X. 

In order to get the graphs connected, add a single vertex with a new color to 
both graphs and connect it with all other vertices. ■ 

5.2 An upper bound 

We now establish an upper bound of 0{v{G)e{H) + e{G)v{H)) for the time com- 
plexity of the AC-Problem. One way to obtain this result is to use the linear-time 
reduction from arc consistency to the satisfiability problem for propositional Horn 
clauses (Horn-Sat) presented in [21]. The reduction transforms the input graphs 
G and H into a propositional Horn formula of size v{G)e{H) + e{G)v{H) that is 
satisfiable iff arc consistency can be established on G and H. The upper bound then 
follows by applying any linear time Horn- Sat algorithm. Going a different way, we 
here show that the same bound can be achieved by a propagation-based algorithm, 
that we call AC'13. On the one hand, AC'13 does much the same of what a linear 
time Horn-Sat solver would do (after applying Kasif's reduction). On the other 
hand, it can be seen as a slightly accelerated version of the algorithm AC-4 [7]. 
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Algorithm 1 AC'13 

Input: Two colored connected graphs G and H. 

/INITIALIZATION*/ 

for all X e V{G) do 

Dx ^ {a G V{H) I a has the same color as a;}; 
if = then return reject; 
for all X e V{G), a e V{H) do 
counter [a; , a] •<— |A(a)|; 
ii a ^ then add (x, a) to Q; 
/*PROPAGATION*/ 
while Q not empty do 

Select and remove {x, a) from Q; 
for all b e N{a) do 

counter [x, 6] •<— counter [x, 6] —1; 
if counter [x, 6] = then 
for all y G N{x) do 
if 6 G -Dj; then 

Delete b from Dy] 

Add {y, b) to Q; 

if Dy — $ then return reject; 

end while 
return accept; 



Theorem 5.2 AC'13 solves the AC-Problem in time 0{v{G)e{H) + e{G)v{H)). 

Proof. We first analyze the running time. The initialization phase requires 
0{v{G)v{H)). The propagation phase takes |iV(a)| steps for every (x, a) G Q and 
|A^(x)| steps for every (x, 6) such that counter [x, 6] gets 0. Since every pair is 
only put once on the queue and every counter voids out only once the total run- 
ning time of the propagation phase bound by Z)(xa)ey(G)xy(i?) (1-^(^)1 + ^ 
v{G)e{H) + e{G)v{H). 

The rest is devoted to the proof of the algorithm's correctness. Translated into 
the language of the existential 2-pebble game, the problem is to decide for a given 
pair of colored graphs G and H which of two cases occurs: Spoiler has a winning 
strategy for some number of rounds or Duplicator has a winning strategy for any 
number of rounds. Simplifying the terminology, we will say that Spoiler wins in the 
former case and Duplicator wins in the latter case. We begin with auxiliary notions 
and claims, then show that a modified version of the algorithm is correct, and finally 
come back to the original version. 

Given a pair (x, a) G V{G) x V{H)^ we denote the existential 2-pebble game 
with the initial position (x, a) by GAME(a;, a). Suppose that S C V{G) x V{H) is 
a set of pairs (x, a) such that Spoiler wins the game GAME(a;, a). We will assume 
that S contains all pairs of differently colored vertices. 
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Let (y, b) ^ S. Given x G V{G) and a G V{H), we call a a partial x-certificate for 
{y, b)ifyE N{x), b G N{a), and (x, a) G S. Assuming y G A^(a;), we denote the set of 
all partial x-certificates for {y, b) by Certy(x, b). Note that Certy(x, 6) = fl N{b), 
where S\x = {a G V{H) : (x, a) G S} is the x-shce of S. It follows that 

Certj^(x, b) = Certy'(x, 6) for any two y, y G N{x), (1) 

that is, Certj^(x,6) actually does not depend on y. 

Furthermore, call x a complete certificate for {y,b) if Certj^(x, 6) = N{b). The 
first of two following claims is straightforward. 

Claim A. If {y,b) has a complete certificate, then Spoiler wins GAME{y,b). 

Claim B. Let G be connected. If Spoiler wins the existential 2-pebble game on G 
and if, then there exists a pair (y, b) ^ S having a complete certificate. 

Proof of Claim B. Assume that no {y, b) ^ S has a complete certificate and show 
that then Duplicator wins the game on G and H. 

Call a vertex x G V{G) complete if S"]!,. = V{H). Under the assumption made, 
no vertex of G is complete. Indeed, if x is complete, then any adjacent to it vertex y 
must be complete too because otherwise we would have {y, b) ^ S for some b G V{H) 
and then x would be a complete certificate for {y, b), contradictory to the assumption. 
It follows by connectedness of G, that S = V{G) x V{H) while S is supposed to be 
a proper subset. 

The absence of complete vertices leads to the following winning strategy for 
Duplicator. Assume that Spoiler pebbles a vertex y in the first round. Duplicator 
responds with a vertex b such that {y, b) ^ S. Such b exists since b is not complete. 
Let Spoiler pebble a vertex x in the next round. If x and y are non-adjacent. 
Duplicator reponds similarly (with a vertex a such that (x, a) ^ S). If x and y are 
adjacent, then Duplicator reponds with a vertex a adjacent to b such that (x, a) ^ S. 
Such a exists because otherwise x would be a complete certificate for Each 
subsequent round is played similarly. < 

We are now ready to describe an algorithm solving the existential 2-pebble game 
on connected colored graphs G and H. We will maintain a set S" C V{G) x V{H) of 
pairs (x, a) for which it is for sure known (certified) that Spoiler wins GAME(x,a). 
Initially, S cosists of those (x, a) with x and a colored differently. Our algorithm will 
try step by step to extend S. If no extention is possible any more, the algorithm 
decides that Spoiler wins if S reaches the full product V{G) x V{H) and that 
Duplicator wins if S stays its proper subset. 

Each time S will be extended with a pair (y, b) ^ S having a complete certificate. 
Note that the correctness of this procedure is ensured by Claims \M and [Bl By 
Claim [HI an extension is always possible if Spoiler wins. Thus, if Spoiler wins, the 
algorithm's decision will be correct because then eventually 5* = V{G) x V{H). On 
the other hand. Claim |A] implies that S consists of positions winning for Spoiler. 
Therefore, if S" = V{G) x V{H), then Spoiler really has a winning strategy in the 
game on G and H. 



14 



We now explain how our algorithms finds a pair {y,b) ^ S with a complete 
certificate. For this purpose, another set Q G S is maintained. This set consists 
of influential pairs (x, a) G S* producing a partial x-certificate for at least one pair 
{y, b) ^ S. Initially, Q = S is the set of pairs of differently colored vertices. For each 
[y, b) ^ S and x G V{G), we also have a counter Cy{x, b) for the number of vertices 
a G N{b) that are still not accepted as a partial x-certificate for {y,b). Initially, 
Cy{x,b) = degb. The algorithm updates S as follows. It takes an arbitrary pair 
(x, a) G Q and accepts partial x-certificate for all {y, b) such that y G A^(x) 

and b G A^(a) by decreasing the value of Cy{x, b) in 1. After this is done, the pair 
(x, a) is not infiuential any more and is removed from Q. Once Cy{x, 6) = for some 
(x, 6), this pair receives a complete certificate, namely x, and is added to both S 
and Q. This completes description of our algorithms. 

The algorithm AC'13 is pretty close to the slightly simplified version we just 
described. Instead of AC'13 maintains the set = V{H)\S\x for each x G V{G) 
and terminates as soon as = for some x. Moreover, the counter Cy{x,b) is 
parametrized only by x and b, which is justified by the equality ([1]). ■ 

5.3 Lower bounds 

Recall that by a propagation-based arc consistency algorithm we mean an algorithm 
that solves the AC-Problem by iteratively deleting possible assignments a to a 
variable x from the domain according to the arc consistency rule and rejects 
iff one domain gets empty. Let us maintain a list L of deleted variable-value pairs 
by putting a pair (x, a) there once a is deleted from D^. If the algorithm detects 
arc-inconsistency, then it is evident that L, prepended with axioms and appended 
with _L, forms a proof of Spoiler's win. Thus, a propagation-based arc consistency 
algorithm can be viewed as a proof search algorithm that produces (in by-passing) 
a proof P of Spoiler's win. This situation is related to the concept of a certify- 
ing algorithm [2S]: Propagation-based algorithms not just detect Spoiler's win but 
also produce its certificate. For every derived element of P an algorithm has to 
recognize its already derived parents. This allows us to relate the running time to 
the proof size. Specifically, given an arbitrary propagation-based algorithm for the 
AC-Problem, let time{G, H) denote the time it takes on input {G, H). If the input 
{G, H) is arc-inconsistent, then it holds 

tzme{G,H) > szze{G,H). (2) 

Theorem 5.3 Fix an arbitrary propagation- based algorithm. 

1. Let Ti{k, I) denote the worst working time of this algorithm over colored graphs 
G and H with e(G) = k and e{H) = I. Then Ti{k, /) > - 1)(/ - 4) for all 
k and I. 

2. Let T2{n) denote the worst working time of the algorithm on inputs {G,H) 
with v{G) + v{H) = n. Then T2{n) > j^n^ for all large enough n. 
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Proof. By Corollary 13 .4^ there are colored graphs Gk with e{Gk) = v{Gk) = k and 
Hi with e{Hi) = v{Hi) — 1 = / for which D{Gk,Hi) is finite but large, specifically, 
D{Gk,Hi) > lik- !)(/ - 4). By the relation ([2]), on input {Gk,Hi) the algorithm 
takes time at least size{Gk, Hi), for which we have size{Gk, Hi) > depth{Gk, Hi) = 
D{Gk, Hi) by part 1 of Theorem O 

Part 2 follows from part 4 of Theorem 14.11 ■ 

Corollary 5.4 In terms of the parameters e{G) and e{H), the time bound 0{e{G) 
■ e{H)) is optimal up to a constant factor among propagation-based algorithms. 

Note that 0{e{G)v{H) + v{G)e{H)) = 0{{v{G) + v{H))^). 

Corollary 5.5 In terms of the parameter n = v{G) + v{H), the time bound 0{n^) 
is best possible for a propagation-based algorithm. 

5.4 Parallel complexity 

It is known that the AC-Problem is PTIME-complete under logspace-reductions 
[211 [15]. Under the assumption that PTIME =^ NC, it follows that the AC-Problem 
cannot be parallelized. However, several parallel algorithms with a polynomial num- 
ber of processors appear in the hterature (e.g., [20j). We are able to show a tight 
connection between the running time of a parallel algorithm and the round com- 
plexity of the existential 2-pebble game. The following result is worth noting since 
D{G, H) = depth{G, H) can be much smaller that size{G, H) (cf. Remark l4.2p . and 
then a parallel propagation-based algorithm can be much faster than any sequential 
propagation-based algorithm. 

Theorem 5.6 

1. AC-Problem can be solved in time 0{D{G, H)) on a CRCW-PRAM with 
polynomially many processors. 

2. Any parallel propagation- based arc consistency algorithm needs time D{G,H) 
on arc-inconsistent instances {G,H). 

Proof. First apply the reduction from Lemma 15.11 to colored simple graphs in 
constant parallel time. Consider the parallelized version of AC-graph and assume 
that Spoiler wins the existential 2-pebble game on G and H. The initialization phase 
can be implemented in constant time. For every element (x, a) E Q the propagation 
phase can also be processed in constant time. The algorithm iteratively processes 
the whole set Q in parallel constant time and computes a new set Q'. Let Qi be the 
queue Q after the ith iteration of the propagation phase and Q<i := IJj<iQj- 
easy induction shows that Q<i (for i < D{G,H)) is the set of all positions (x, a) e 
V{G) X V{H) such that Spoiler wins in at most i steps. Hence, for / = D{G, H)-l 
it holds that {x} x V{H) C Q^i where x is the first vertex Spoiler puts a pebble on. 
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But this means that in iteration / all values from are already deleted and hence 
the algorithm rejects. 

A parallel propagation-based algorithm produces proofs of Spoiler's win. Hence, 
the algorithm can derive {x, a) only if the parents in the underlying proof have 
been derived. It follows that the parallel running time has to be lower bounded by 
depth{G,H) = D{G,H). m 

6 Conclusion and further questions 

We investigated the round complexity D{G,H) = D'^{G,H) of the existential 2- 
pebble game on colored graphs and established lower bounds of the form Q{v{G)v{H)), 
which translate to lower bounds on the nested propagation steps in arc consistency 
algorithms. The next step in this line of research is to investigate the number of 
rounds D^{G,H) in the existential 3-pebble game that interacts with path consis- 
tency algorithms in the same way as the 2-pebble game with arc consistency. Note 
that, similarly to Corollary D%G,H) = 0{v{Gfv{Hf). Ladkin and Mad- 
dux [26] showed that D^{G,H) = f2(t>(G)^) using algebraic methods (where H is 
a graph of constant size). Using methods from [2] one can construct examples 
of graphs with D^{G,H) = Q{v{Hy) (where G is a graph of constant size). It 
remains for future work to exhibit graphs both on n vertices, such that 

D^{Gn,Hn) = Q{v{Gfv{Hf). This would translate to an ^(n'^) lower bound for 
sequential and parallel path consistency algorithms. 

By Corollary 12. 3[ D[A, B) < v{A)v{B) + 1 for arbitrary binary structures A and 
B with D{A,B) < oo. On the other hand, for the Domino example Am,Bn with 
even n we have D{Am,Bn) > ^v{Am)v{Bn). An interesting problem is to close the 
gap between these bounds. We conjecture that the lower bound of | v{A)v{B) is 
sharp. 

Finally, we want to stress that our lower bounds for the time complexity of arc 
consistency hold only for constraint propagation-based algorithms. Is there a faster 
way to solve the AC-Problem using a different approach? 
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